Skip to main content

Internet Archive Web Crawls

The Internet Archive discovers and captures web pages through many different web crawls.



rss RSS

Show sorted alphabetically
Show sorted alphabetically
SHOW DETAILS
up-solid down-solid
eye
Title
Date Reviewed
Creator
Survey Crawl Number 7
Apr 6, 2021 Internet Archive
web
eye 615,322
favorite 0
comment 1
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl841.us.archive.org:survey from Sun Mar 4 08:25:03 PST 2018 to Mon Mar 5 18:20:40 PST 2018.
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Wide Crawl Number 15: Started Oct 1st, 2016 - Ended May 8th, 2017
Jan 30, 2021 Internet Archive
web
eye 657,670
favorite 0
comment 1
Internet Archive crawldata from Webwide Crawl, captured by crawl814.us.archive.org:wide from Sat Oct 1 15:28:56 PDT 2016 to Sun Oct 2 23:53:49 PDT 2016.
( 1 reviews )
Topic: crawldata
Wide Crawl Number 14 - Started Mar 4th, 2016 - Ended Sep 15th, 2016
Jan 30, 2021 Internet Archive
web
eye 1.2M
favorite 0
comment 1
Internet Archive crawldata from Webwide Crawl, captured by crawl824.us.archive.org:wide from Thu Jun 16 19:15:17 PDT 2016 to Fri Jul 1 20:09:14 PDT 2016.
favoritefavorite ( 1 reviews )
Topic: crawldata
YouTube 2007 Crawl
web
eye 64,353
favorite 0
comment 1
This is an element of the Crawl IA-YOUTUBE-000 dataset from InternetArchive
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Youtube Videos
Nov 28, 2020 Internet Archive
web
eye 930,981
favorite 0
comment 1
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl440.us.archive.org:youtube from Sat Jul 21 05:39:04 PDT 2012 to Fri Jul 20 23:46:43 PDT 2012.
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Live Web Proxy Crawls
Nov 28, 2020
web
eye 47.3M
favorite 3
comment 4
favoritefavoritefavoritefavoritefavorite ( 4 reviews )
Youtube Videos
Sep 15, 2020 Internet Archive
web
eye 12
favorite 0
comment 1
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl819.us.archive.org:youtube from Tue Sep 15 17:12:41 PDT 2020 to Tue Sep 15 10:32:19 PDT 2020.
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Live Web Proxy Crawls
Jul 1, 2020 Internet Archive
web
eye 2.2M
favorite 0
comment 1
Internet Archive Liveweb Capture from WayBack Machine, captured by wwwb-live3.us.archive.org from 2013-06-11T17:38:46 UTC to 2013-06-11T21:24:17 UTC.
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Wide Crawl Number 17: Started August 3rd, 2018 - Still running
Jun 23, 2020 Internet Archive
web
eye 3.9M
favorite 0
comment 1
Internet Archive crawldata from Webwide Crawl, captured by crawl805.us.archive.org:wide from Mon May 13 17:55:38 PDT 2019 to Mon May 13 13:45:55 PDT 2019.
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Wayback Indexes
web
eye 6.1M
favorite 0
comment 1
Data crawled by Internet Archive on behalf of Internet Archive from Fri Nov 01 06:23:33 PDT 2002 to Tue Nov 19 23:24:07 PDT 2002
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Youtube Videos
Aug 1, 2019 Internet Archive
web
eye 19
favorite 0
comment 1
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl823.us.archive.org:youtube from Thu Aug 1 06:21:17 PDT 2019 to Wed Jul 31 23:31:25 PDT 2019.
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Youtube Videos
Jul 4, 2019 Internet Archive
web
eye 27
favorite 0
comment 1
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl821.us.archive.org:youtube from Mon Feb 11 12:34:17 PST 2019 to Mon Feb 11 04:48:30 PST 2019.
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Live Web Proxy Crawls
Apr 4, 2019 Internet Archive
web
eye 17.9M
favorite 7
comment 1
Internet Archive Liveweb Capture from WaybackMachine, captured by wwwb-proxy0.us.archive.org:wbm from Sun Mar 27 22:10:09 PDT 2011 to Mon Mar 28 05:27:05 PDT 2011.
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Live Web Proxy Crawls
Mar 9, 2019
web
eye 41,219
favorite 0
comment 1
favoritefavoritefavorite ( 1 reviews )
Live Web Proxy Crawls
Dec 13, 2018 Internet Archive
web
eye 1.5M
favorite 0
comment 2
Internet Archive Liveweb Capture from WayBack Machine, captured by wwwb-live3.us.archive.org from 2013-08-14T05:36:46 UTC to 2013-08-14T16:31:43 UTC.
favoritefavorite ( 2 reviews )
Topic: crawldata
google ngrams
Dec 26, 2013 Google, Inc.
web
eye 28
favorite 0
comment 1
This item contains the Google ngram data for the American English languageset. ​​​​​ Here are the datasets backing the Google Books Ngram Viewer. These datasets were generated in July 2009; we will update these datasets as our book scanning continues, and the updated versions will have distinct and persistent version identifiers (20090715 for the current set). Each of the numbered links below will directly download a fragment of the given corpus. For instance, the first ten links...
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Live Web Proxy Crawls
Aug 6, 2013 Internet Archive
web
eye 1.5M
favorite 0
comment 1
Internet Archive Liveweb Capture from WayBack Machine, captured by wwwb-live4.us.archive.org from 2013-07-13T11:35:01 UTC to 2013-07-14T12:32:30 UTC.
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Youtube Videos
web
eye 4
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl823.us.archive.org:youtube from Sun Aug 2 01:23:24 PDT 2020 to Sat Aug 1 18:35:37 PDT 2020.
Topic: crawldata
Youtube Videos
web
eye 2
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl858.us.archive.org:youtube from Tue Aug 4 21:49:30 PDT 2020 to Tue Aug 4 15:15:53 PDT 2020.
Topic: crawldata
Youtube Videos
web
eye 5
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl857.us.archive.org:youtube from Tue Aug 4 21:08:36 PDT 2020 to Tue Aug 4 14:34:02 PDT 2020.
Topic: crawldata
Youtube Videos
web
eye 2
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl857.us.archive.org:youtube from Thu Aug 6 10:52:24 PDT 2020 to Thu Aug 6 04:08:06 PDT 2020.
Topic: crawldata
Youtube Videos
web
eye 4
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl858.us.archive.org:youtube from Mon Aug 3 09:48:20 PDT 2020 to Mon Aug 3 03:12:38 PDT 2020.
Topic: crawldata
Youtube Videos
web
eye 2
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl810.us.archive.org:youtube from Thu Aug 6 09:09:03 PDT 2020 to Thu Aug 6 02:34:36 PDT 2020.
Topic: crawldata
Wide Crawl started April 2012
web
eye 538
favorite 0
comment 0
Internet Archive crawldata from Webwide Crawl, captured by crawl421.us.archive.org:wide from Mon Jun 11 04:28:22 PDT 2012 to Sun Jun 10 23:35:09 PDT 2012.
Topic: crawldata
Youtube Videos
web
eye 2
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl857.us.archive.org:youtube from Wed Aug 5 14:49:14 PDT 2020 to Wed Aug 5 08:06:45 PDT 2020.
Topic: crawldata
Youtube Videos
web
eye 4
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl822.us.archive.org:youtube from Mon Aug 3 18:27:34 PDT 2020 to Mon Aug 3 12:07:26 PDT 2020.
Topic: crawldata
Youtube Videos
web
eye 31
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl821.us.archive.org:youtube from Sat Apr 1 08:20:00 PDT 2017 to Sat Apr 1 01:39:06 PDT 2017.
Topic: crawldata
Youtube Videos
web
eye 2
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl834.us.archive.org:youtube from Thu Aug 6 10:26:13 PDT 2020 to Thu Aug 6 04:02:47 PDT 2020.
Topic: crawldata
Youtube Videos
web
eye 2
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl820.us.archive.org:youtube from Wed Aug 5 19:32:04 PDT 2020 to Wed Aug 5 13:15:38 PDT 2020.
Topic: crawldata
Youtube Videos
web
eye 4
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl820.us.archive.org:youtube from Sat Aug 1 20:08:20 PDT 2020 to Sat Aug 1 13:42:19 PDT 2020.
Topic: crawldata
Youtube Videos
web
eye 2
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl837.us.archive.org:youtube from Sat Aug 8 05:33:15 PDT 2020 to Fri Aug 7 22:57:14 PDT 2020.
Topic: crawldata
Google Video
web
eye 4
favorite 0
comment 0
Internet Archive crawldata from Google Video archiving project 2011, captured by crawl336.us.archive.org:gcap from Wed Jul 20 17:58:00 PDT 2011 to Wed Jul 20 12:56:13 PDT 2011.
Topic: crawldata
Youtube Videos
web
eye 4
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl110.us.archive.org:youtube from Mon Aug 3 05:17:59 PDT 2020 to Sun Aug 2 22:37:08 PDT 2020.
Topic: crawldata
Youtube Videos
web
eye 4
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl110.us.archive.org:youtube from Mon Aug 3 18:40:58 PDT 2020 to Mon Aug 3 12:05:01 PDT 2020.
Topic: crawldata
Youtube Videos
web
eye 4
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl838.us.archive.org:youtube from Mon Aug 3 18:09:54 PDT 2020 to Mon Aug 3 11:28:43 PDT 2020.
Topic: crawldata
Youtube Videos
web
eye 4
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl834.us.archive.org:youtube from Mon Aug 3 10:04:29 PDT 2020 to Mon Aug 3 03:35:23 PDT 2020.
Topic: crawldata
Yahoo! Video Crawl
web
eye 6
favorite 0
comment 0
Internet Archive crawldata from Yahoo! Video archiving project 2011, captured by crawl336.us.archive.org:ycap from Mon Mar 28 17:25:38 PDT 2011 to Mon Mar 28 11:33:55 PDT 2011.
Topic: crawldata
Youtube Videos
web
eye 24
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl821.us.archive.org:youtube from Mon Jul 18 01:08:45 PDT 2016 to Sun Jul 17 18:29:39 PDT 2016.
Topic: crawldata
Google Video
web
eye 2
favorite 0
comment 0
Internet Archive crawldata from Google Video archiving project 2011, captured by crawl335.us.archive.org:gcap from Sun Jul 10 16:31:01 PDT 2011 to Sun Jul 10 11:33:26 PDT 2011.
Topic: crawldata
crawl_UNK
web
eye 4
favorite 0
comment 0
This is an element of the Crawl UNK dataset from Alexa Internet
Yahoo! Video Crawl
web
eye 6
favorite 0
comment 0
Internet Archive crawldata from Yahoo! Video archiving project 2011, captured by crawl333.us.archive.org:ycap from Fri Mar 25 21:57:34 PDT 2011 to Fri Mar 25 16:00:09 PDT 2011.
Topic: crawldata
Google Video
web
eye 4
favorite 0
comment 0
Internet Archive crawldata from Google Video archiving project 2011, captured by crawl330.us.archive.org:gcap from Sun Jul 17 06:36:56 PDT 2011 to Sun Jul 17 01:39:09 PDT 2011.
Topic: crawldata
Yahoo! Video Crawl
web
eye 7
favorite 0
comment 0
Internet Archive crawldata from Yahoo! Video archiving project 2011, captured by crawl316.us.archive.org:ycap from Sun Mar 27 03:37:46 PDT 2011 to Sun Mar 27 00:16:14 PDT 2011.
Topic: crawldata
Google Video
web
eye 26
favorite 0
comment 0
Internet Archive crawldata from Google Video archiving project 2011, captured by crawl338.us.archive.org:gcap from Thu Jul 28 07:40:59 PDT 2011 to Thu Jul 28 02:41:00 PDT 2011.
Topic: crawldata
Google Video
web
eye 26
favorite 0
comment 0
Internet Archive crawldata from Google Video archiving project 2011, captured by crawl337.us.archive.org:gcap from Sun Jul 17 17:32:13 PDT 2011 to Sun Jul 17 12:33:15 PDT 2011.
Topic: crawldata
Youtube Videos
web
eye 5
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl820.us.archive.org:youtube from Sun Apr 19 07:01:55 PDT 2020 to Sun Apr 19 00:18:43 PDT 2020.
Topic: crawldata
Google Video
web
eye 1
favorite 0
comment 0
Internet Archive crawldata from Google Video archiving project 2011, captured by crawl336.us.archive.org:gcap from Sat Jul 9 20:21:08 PDT 2011 to Sat Jul 9 15:17:18 PDT 2011.
Topic: crawldata
Google Video
web
eye 18
favorite 0
comment 0
Internet Archive crawldata from Google Video archiving project 2011, captured by crawl330.us.archive.org:gcap from Sat Jul 30 16:06:18 PDT 2011 to Sat Jul 30 11:38:13 PDT 2011.
Topic: crawldata
Yahoo! Video Crawl
web
eye 6
favorite 0
comment 0
Internet Archive crawldata from Yahoo! Video archiving project 2011, captured by crawl337.us.archive.org:ycap from Fri Mar 18 18:51:24 PDT 2011 to Fri Mar 18 12:39:38 PDT 2011.
Topic: crawldata
Google Video
web
eye 3
favorite 0
comment 0
Internet Archive crawldata from Google Video archiving project 2011, captured by crawl333.us.archive.org:gcap from Thu Jul 7 10:20:38 PDT 2011 to Thu Jul 7 05:19:25 PDT 2011.
Topic: crawldata
crawl_UNK
web
eye 3
favorite 0
comment 0
This is an element of the Crawl UNK dataset from Alexa Internet
Google Video
web
eye 2
favorite 0
comment 0
Internet Archive crawldata from Google Video archiving project 2011, captured by crawl339.us.archive.org:gcap from Tue Jun 7 08:58:22 PDT 2011 to Tue Jun 7 04:25:53 PDT 2011.
Topic: crawldata
Google Video
web
eye 4
favorite 0
comment 0
Internet Archive crawldata from Google Video archiving project 2011, captured by crawl330.us.archive.org:gcap from Fri May 13 03:16:47 PDT 2011 to Sat May 14 03:50:40 PDT 2011.
Topic: crawldata
Youtube Videos
web
eye 4
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl820.us.archive.org:youtube from Tue Apr 21 20:40:11 PDT 2020 to Tue Apr 21 13:52:38 PDT 2020.
Topic: crawldata
Yahoo! Video Crawl
web
eye 6
favorite 0
comment 0
Internet Archive crawldata from Yahoo! Video archiving project 2011, captured by crawl317.us.archive.org:ycap from Sun Mar 27 02:38:34 PDT 2011 to Sat Mar 26 21:42:43 PDT 2011.
Topic: crawldata
Google Video
web
eye 31
favorite 0
comment 0
Internet Archive crawldata from Google Video archiving project 2011, captured by crawl330.us.archive.org:gcap from Sat Jul 2 07:01:03 PDT 2011 to Sat Jul 2 02:05:47 PDT 2011.
Topic: crawldata
Google Video
web
eye 1
favorite 0
comment 0
Internet Archive crawldata from Google Video archiving project 2011, captured by crawl333.us.archive.org:gcap from Sat Jun 25 19:02:41 PDT 2011 to Sat Jun 25 13:58:20 PDT 2011.
Topic: crawldata
Yahoo! Video Crawl
web
eye 5
favorite 0
comment 0
Internet Archive crawldata from Yahoo! Video archiving project 2011, captured by crawl308.us.archive.org:ycap from Mon Mar 28 03:35:35 PDT 2011 to Sun Mar 27 21:24:29 PDT 2011.
Topic: crawldata
Google Video
web
eye 1
favorite 0
comment 0
Internet Archive crawldata from Google Video archiving project 2011, captured by crawl336.us.archive.org:gcap from Tue Jun 28 08:33:21 PDT 2011 to Tue Jun 28 03:37:21 PDT 2011.
Topic: crawldata
Google Video
web
eye 21
favorite 0
comment 0
Internet Archive crawldata from Google Video archiving project 2011, captured by crawl334.us.archive.org:gcap from Mon Jul 4 13:43:15 PDT 2011 to Mon Jul 4 08:42:32 PDT 2011.
Topic: crawldata
Google Video
web
eye 8
favorite 0
comment 0
Internet Archive crawldata from Google Video archiving project 2011, captured by crawl331.us.archive.org:gcap from Mon Jul 18 22:18:11 PDT 2011 to Mon Jul 18 17:17:24 PDT 2011.
Topic: crawldata
crawl_UNK
web
eye 5
favorite 0
comment 0
This is an element of the Crawl UNK dataset from Alexa Internet
Youtube Videos
web
eye 3
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl820.us.archive.org:youtube from Sat Apr 4 00:11:27 PDT 2020 to Fri Apr 3 17:24:10 PDT 2020.
Topic: crawldata
Yahoo! Video Crawl
web
eye 7
favorite 0
comment 0
Internet Archive crawldata from Yahoo! Video archiving project 2011, captured by crawl340.us.archive.org:ycap from Wed Mar 9 10:29:22 PST 2011 to Wed Mar 9 04:46:06 PST 2011.
Topic: crawldata
Yahoo! Video Crawl
web
eye 6
favorite 0
comment 0
Internet Archive crawldata from Yahoo! Video archiving project 2011, captured by crawl332.us.archive.org:ycap from Sun Mar 20 12:28:09 PDT 2011 to Sun Mar 20 07:33:33 PDT 2011.
Topic: crawldata
Yahoo! Video Crawl
web
eye 8
favorite 0
comment 0
Internet Archive crawldata from Yahoo! Video archiving project 2011, captured by crawl342.us.archive.org:ycap from Thu Mar 24 08:40:47 PDT 2011 to Thu Mar 24 02:33:00 PDT 2011.
Topic: crawldata
Wayback CDX Shards
data
eye 0
favorite 0
comment 0
Youtube Videos
web
eye 4
favorite 0
comment 0
Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl819.us.archive.org:youtube from Thu Apr 2 09:12:20 PDT 2020 to Thu Apr 2 02:33:49 PDT 2020.
Topic: crawldata
Google Video
web
eye 5
favorite 0
comment 0
Internet Archive crawldata from Google Video archiving project 2011, captured by crawl342.us.archive.org:gcap from Wed May 25 19:15:00 PDT 2011 to Wed May 25 16:41:35 PDT 2011.
Topic: crawldata
Google Video
web
eye 40
favorite 0
comment 0
Internet Archive crawldata from Google Video archiving project 2011, captured by crawl332.us.archive.org:gcap from Sun Jun 26 09:48:32 PDT 2011 to Sun Jun 26 04:49:05 PDT 2011.
Topic: crawldata
crawl_UNK
web
eye 17
favorite 0
comment 0
This is an element of the Crawl UNK dataset from Alexa Internet
Google Video
web
eye 2
favorite 0
comment 0
Internet Archive crawldata from Google Video archiving project 2011, captured by crawl331.us.archive.org:gcap from Sat Jun 18 03:31:32 PDT 2011 to Fri Jun 17 23:57:43 PDT 2011.
Topic: crawldata
crawl_UNK
web
eye 6
favorite 0
comment 0
This is an element of the Crawl UNK dataset from Alexa Internet
Yahoo! Video Crawl
web
eye 8
favorite 0
comment 0
Internet Archive crawldata from Yahoo! Video archiving project 2011, captured by crawl343.us.archive.org:ycap from Thu Mar 10 15:38:39 PST 2011 to Thu Mar 10 17:26:21 PST 2011.
Topic: crawldata
crawl_UNK
web
eye 2
favorite 0
comment 0
This is an element of the Crawl UNK dataset from Alexa Internet